Cross-talk and transitions between multiple spatial maps in an attractor neural 
network model of the hippocampus: phase diagram (I) 
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We study the stable phases of an attractor neural network model, with binary units, for hip- 
pocampal place cells encoding ID or 2D spatial maps or environments. Using statistical mechanics 
tools we show that, below critical values for the noise in the neural response and for the number 
of environments, the network activity is spatially localized in one environment. We calculate the 
number of stored environments. For high noise and loads the network activity extends over space, 
either uniformly or with spatial heterogeneities due to the cross-talk between the maps, and memory 
of environments is lost. Analytical predictions are corroborated by numerical simulations. 



I. INTRODUCTION 

Understanding the representation of space by the brain 
is a long-lasting question, which has been adressed us- 
ing many varied methods. This includes memory of 
places, localization of one's position, mental exploration 
and planning of forccoming trajectories. During the last 
decades, the use of microelectrodes allowing single cell 
recordings has revolutionized our knowledge of neural 
networks. In 1971, O'Keefe & Dostrovsky [T] recorded 
neural activity in the hippocampus of rats and discov- 
ered the existence of place cells, which fire only when the 
animal is located in a certain position in space (called 
place field). This discovery suggested that hippocampus 
could be the support for space representation or a 'cogni- 
tive map'. Since then, many experimental and theoretical 
studies have been carried on hippocampus, making it one 
of the most, if not the most studied part of the brain [2]. 

The properties of place cells, their conditions of forma- 
tion and the sensory and behavioral correlates of place 
fields have been investigated experimentally |3h5j. Place 
fields have the striking property to appear as randomly 
distributed, independently of the neurons locations in 
the neural tissue: two neighbouring neurons can have 
very distant place fields. Furthermore, several 'environ- 
ments' or 'maps' can be learned, and a given neuron can 
have place fields in several environments, which are ap- 
parently randomly assigned, a property called remapping 
[6]. Place fields are controlled primarily by visual cues 
[7] but the activity of place cells persists in the dark [5] 
and is also driven by self-motion signals, that is, 'path 
integration' [9|. More recently, the discovery of grid cells 
[TUl [TT| in the enthorinal cortex (that feeds input into 
the hippocampus) opened a new way in the comprehen- 
sion of a complex system of interacting brain regions |12j . 
Many theoretical models have been proposed to account 
for these experimental results. Beyond the comprehen- 
sion of the hippocampus itself, the motivation is to reach 
more insights about the functional principles of the brain 

Experiments show that the hippocampus is able to 
learn, memorize and retrieve spatial maps. The mas- 
sive intrinsic connectivity in hippocampus CAS led to 



the hypothesis of an attractor neural network [131 HI] 
where memorized activity patterns are the attractors of 
the dynamics, such as in the celebrated Hopfield model 
|15j . In the Hopfield model it is assumed that the pat- 
terns are additively stored in the synapses, through a 
Hebbian learning mechanism. A deep and quantitative 
understanding of the Hopfield model was made possible 
by the use of the statistical physics theory of mean-field 
spin glasses [TBI Hll ■ In the case of the rodent hippocam- 
pus, the memorized items are space manifolds called envi- 
ronments '^ . Neural network models for place cells have 
been proposed allowing to perform formal computations, 
in particular by Battaglia & Treves, who carried out a 
mean-field calculation of the storage performance of a 
network with linear threshold units [IH]. Recently Hop- 
field proposed a similar model for mental exploration in 
a network with adaptation ^9\. However, the cross-talk 
between the different environments encoded in the net- 
work, and the transitions that can occur between them as 
observed experimentally [20; remain poorly understood. 



Here, we propose a mean-field model of interacting bi- 
nary units and study the different regimes of activity in 
the presence of neural noise. The model is defined in Sec- 
tion IH] We study the case where multiple environments 
are memorized in Section |III[ and derive the different 
regimes of activity of the network under given conditions 
of neural noise and memory load in Section [lV} T he phase 
diagram of the system is computed in Section|V|and com- 
pared to numerical simulations. We show that an activ- 
ity of the network that is locally spatialized in one of 
the stored maps, as observed experimentally, is the sta- 
ble state of the network provided that both the neural 
noise and the memory load are small enough. For high 
noise and/or loads the the activity is delocalized in all en- 
vironments, either uniformly over space or with spatial 
heterogeneities controled by the cross-talk between envi- 
ronments (glassy phase). We finally discuss the value of 
the parameters (Section VI) and the hypothesis of the 
model (Section VIIj ) compared to previous works. The 
study of the landscape and of the dynamics of the model 
will be addressed in a companion publication j21]. 



II. THE MODEL 



Definition 



The N place cells are modeled by interacting binary 
units ai equal to or 1, equivalent to Ising spins and 
corresponding to, respectively, silent and active states. 
We suppose that, after learning of the environment and 
random allocation of place fields, each place cell preferen- 
tially fires when the animal is located in an environment- 
specific location in the Z)-dimensional space, defining its 
place field. For simplicity space is assumed to be a seg- 
ment of length N ior D = I, and a square of edge length 
\/N in D — 2, with periodic boundary conditions. The 
N centers of the place fields are assumed to be perfectly 
located on a D-dimensional regular grid: two contigu- 
ous centers are at unit distance from each other. This 
assumption is not necessary (heterogeneous locations of 
place fields in space can be considered), but allows us to 
remove one source of randomness and to concentrate on 
the interference between the stored spatial maps as one 
of the main sources of noise. 

Let dc be the extension of a place field, that is, the 
maximal distance between locations in space recognized 
by the same place cell. Place cells whose place fields over- 
lap, and, therefore, spike simultaneously as the animal 
wanders in the environment, are assumed to strengthen 
their synaptic connections. Calling dij the distance be- 
tween the place field centers of cells i,j in the environ- 
ment we assume that the reinforcement process ends up 
with synaptic couplings given by 



J°- - 



j_ 

N 

if 



if dij < dc 
dij 



> dc 



(1) 



The positive sign of the couplings ensures that they are 
excitatory (ferromagnetic in spin language). We choose 
the place extension dc such that each cell i is connected 
to the same number of other cells j, independently of the 
space dimension D. Let w N he this number: w(<C 1) is 
the fraction of the neural population any neuron is cou- 
pled to. This scaling is a consequence of the assumption 
of place fields covering a fixed fraction of space; conse- 
quently our model is mean-field. Hence, dc — ^N in 



dimension D = 1, and dc = 
The 



in dimension D = 2. 



jj scale factor is such that the total contribution 
to the local field received by a place cell is finite when 
the number of cells, N, is sent to infinity. Note that we 
assume here that the environment is perfectly explored: 
couplings depend on the distance dij only, and not on 
the particular sequence of positions occupied by the ani- 
mal during the time spent in the environment. The case 
of partial, non-homogeneous explorations was studied in 
[2]. Couplings defined by prescription ([I]) are symmet- 
ric, and only reflect the local structure of the environ- 
ment, irrespectively of the exploration process. 

Each time the rodent explores a new environment a 
remapping of the place fields takes place. Let L be the 



number of explored environments, in addition to the envi- 
ronment above (hereafter called reference environment). 
We assume that the remapping can be represented by 
a random permutation of the N place-cell indices asso- 
ciated to the place fields in the reference environment, 
denoted by £ = 0. Let n^ be the permutation corre- 
sponding to remapping number i, where i = 1, . . . , L is 
the index of the environment. In environment i cells in- 
teract if the distance d„i(^i'jT^e(^j) is smaller than dc, and do 
not interact at larger distances. An obvious modification 
of (nj) defines the coupling matrix J^ corresponding to 
environment £. We finally assume that all environments 
contribute equally and additively to the total synaptic 
matrix, 



L 

Jtj — 2_^^i:, — 'Ji] 

1=0 



Y.J'' 



(iWiJ) 



(2) 



For the sake of a better understanding, we can consider 
an example of a matrix J in the very simple case iV = 6, 
-01= |, L-|-I = 2 and D = 1, illustrated in figure (nj). 
For the reference environment the coupling matrix is 



J° 





/O 1 1 \ 




10 10 


1 


10 10 


6 


10 10 




10 1 




Vl 1 0/ 



(3) 



For another environment obtained through the random 
permutation vr = (3, 6, 1, 5, 2, 4) we obtained the coupling 
matrix 



/O 1 1\ 
110 



Ji = 



10 10 
10 1 



10 10 

V 1 1 oy 



(4) 



The total coupling matrix for the two maps is there- 
fore: 



^-\ 



/O 1 1 2\ 
10 2 10 
2 110 
110 11 
10 110 1 

V2 1 1 0/ 



(5) 



In addition to pyramidal cells, the network contains 
long-range, inhibitory interneurons whose activity is 
modeled by a global inhibition on place cells. We as- 
sume that the main effect of inhibition is to fix the total 
neural activity. We introduce the parameter / to denote 
the fraction of active cells: 



Af 



Y.^. = fN. 



(6) 





FIG. 1: Example of remapping of the place field centers of 
A^ = 6 neurons (denoted by indices 1,..,6) in two different ID 
environments with periodic boundary conditions and u; = |. 
Place fields in each environment are represented by colored 
dashed lines, place field centers are denoted by letters a,..,f. 



Once the coupling matrix J^- (|2|) and the constraint 
over the global activity ^ are derinecl the probability 
of a neural activity configuration a = (cti, a2, ■ ■ ■ , on) is 
assumed to be 



Pj{<t) 



1 



exp(-^j[^]/r) , 



Zj{T) 
where the 'energy' of the configuration reads 



^j\.^\ ^-^Jij'^i'^3 



(7) 



(8) 



i<j 



and the partition function is defined through 



Zj{T)= J2 ^^P' 

a- with constraint mi 



Ej[a]/T). (9) 



Parameter T, which plays the role of temperature in sta- 
tistical mechanics, fixes the amount of noise in the model. 
Large values of T corresponds to essentially flat distribu- 
tions over the neural configuration space. Low T concen- 
trate the probability distribution Pj around the config- 
urations with lowest energies Ej. 

In all numerical computations hereafter we will take the 
parameters values w — 0.05 and / = 0.1, except in Sec- 
tion IVl] where these values will be discussed. 



B. Case of a single environment 

The present model is an extension of the Hopfield 
model to the case of space-dependent interactions [IS]. 
Despite this additional complexity in the model it re- 
mains exactly solvable in the infinite N limit due to the 
extensivity of the number of neighbors of each spin |22j . 

We start by considering the case of a single environ- 
ment, for which the coupling matrix is given by (fTl). To 



lighten notations we consider the D = I case; equations 
for the D = 2 case are found in Appendix |A 1[ In the 
large A'^ limit, a continuous approach can be introduced 
by defining the locally coarse-grained activity 



p(x) = lim lim — — 



l)N<i<{x-^)N 



x'^ilJ ; 



(10) 



where {.) j denotes the average over distribution Pj (l7|. 
Due to the presence of periodic boundary conditions we 
choose a; € [— j; 2]- The density of activity p{x) is found 
upon minimization of the free energy functional 

^{{p{x)}) " ^2 / '^^^^ p{^)Jwix " y)p{y) (11) 



T / dx 



p{x) \ogp{x) + (1 - p{x)) log(l - p{x)) 



where Jw{u) = 1 if |u| < ^, and otherwise. The mini- 
mum is taken over the activity densities fulfilling 



Ax p[x) = / 



All integrals run over the {—\\ \] interval. 



(12) 



The minimization equation for p{x) can be written as 
1 



(13) 



p{x) = 
li{x) = 



where p{x) plays the role of a chemical potential, and the 
constant A is chosen to satisfy constraint (12 1. We will 



1 + e-^(^)/^ ' 

dyJ^{x^y)p{y) + X, (14) 



discuss the different solutions of these equations in the 
following sections. Note that the free energy per site. 



F(T)= hm -^\ogZj{T) 



(15) 



is simply given by the value of the free-energy functional 
J- in its minimum p{x), solution of (13|14). 



C. Relationship with rate models 

Neurons are often described by their firing rate, i.e. 
the short-term average of the number of spikes they emit. 
A straightforward relationship can be drawn with binary 
models [231 . The current incoming onto neuron i evolves 
according to 



_dli^ 

dt 



-I,+^J,,g{I,) 



(16) 



Here, g{x) is the characteristic function expressing the 
firing rate of the neuron as a function of the current. It 
is a sigmoidal function, running between and 1 (satu- 
ration of the postsynaptic neuron at high currents), and 



Jij includes both the positive coupUng J° (m) between 
neighboring cells, and a constant, global inhibition con- 
tribution J^, whose value is chosen to enforce condition 
m. The dynamical equation admits a stationary state, 
implicitly defined through 



Ii=^ Ji] aiij 



Identifying 



and choosing 



li -^ fJ-t 



9{I) 



lih) -^ Pi 



1 



l + exp(-//r) 



(17) 



(18) 



(19) 



we observe that equation ( 17) for the stationary currents 
is identical to equation ( 13 ) for the chemical potential 



in the single-environment case. The constant term A in 
(131 is related to the constant inhibitory contribution to 
J through X — J^ f. Parameter T fixes the slope of g at 
the origin. 

As a consequence, the observables of the Ising model 
(density of activity, chemical potential) are in one-to-one 
correspondence with the defining features (firing rates, 
currents) of the stationary states of the neural dynamics. 
Note that this correspondence also holds in the case of 
multiple environments, as we shall see in the next Sec- 
tion. 



III. STATISTICAL MECHANICS OF THE 
MULTIPLE ENVIRONMENT CASE 

A. Average over random remappings 

In the presence of multiple environments the parti- 
tion function Zj becomes a stochastic variable, which 
depends on the L remappings, or, equivalently, on the L 
random permutations tt^, with £ — 1 . . . L. We assume 
that, in the large N limit, the free energy of the system 
is self-averaging, i.e. concentrated around the average. 
To compute the average free energy we need to average 
the logarithm of Zj{T) over the random permutations. 
To do so we use the replica method: we first compute 
the n*'* moment of Zj{T), and then send n -> 0. The 
neural configuration is now a set cr = (cr^, . . . , <t") of 
n X N spins erf, where i — I...N is the spin index and 
a = 1 ... 71 is the replica index. The n*'' moment of the 
partition function reads 



Zj(T)" = ^exp 
= $]exp 



a=l i<j \ 



1=1 



a— 1 i<.'j 



s(<?)^ (20) 



where /3 = 1/T and the overbar denotes the average over 
the random remappings. The sum over ff is restricted to 
configurations with average activity equal to / (within 
each replica), and 



^(^)-i^E 



exp 



/^E'^SE<^w< 



•■u) 



1<J 



(21) 



The calculation of the average over the random permu- 
tation TT^ is not immediate, but can be done exactly in 
the large N limit. Details are reported in Appendix [B| 
The result is 

logS(^) - -^nf{l-f)+N^nwf (22) 

- Y, Trace log [ld„ - /3A(q - f 1„)] , 

where Id„ denotes the n~dimensional identity matrix, q 
is the overlap matrix with entries 



^,ab 



^S""' 



(23) 



and 1„ is the n x n matrix whose all entries are equal to 
one. The sum in (22 1 runs over all the non-zero eigenval- 
ues of the matrix J^ Explicit expressions for those eigen- 
values will be given in the next Section for the D = 1 
case, while the two-dimensional case is treated in Ap- 
pendix |A2[ 



A key feature of expression ( 22 ) is that S depends on 
the spin configuration ^ through the overlaps q"''' only. 
Those overlaps thus play the role of order parameters 
for the activity in the environment £ > 1, as does p{x) 
for the environment 0. Calculation of the n*'' moment 
of the partition function therefore amounts to estimating 
the entropy of neural acitvity configuration ct at fixed 
{q'^^,p{x)}, which can be done exactly in the iV -> oo 
limit. 



B. Replica-symmetric theory 



To perform the n — >■ limit we make use of the replica 
symmetric Ansatz, which assumes that the overlaps g"^ 
take a single value, q, for replica indices a ^ h. The 
validity of the Ansatz will be discussed in Sect ion [Tvl The 
Edwards-Anderson order parameter g, defined through 



1 

9= T7 



N 

N ^ 
=1 



\<^.? 



J ' 



(24) 



measures the fluctuations of the local spin magnetizations 
from site to site. Values for q range from p to /. We 
expect q to be equal to /^ when the local activity {ci)j 
(averaged over the configurations with distribution Pj) 
is uniform over space, and to be larger otherwise. 



As in the single environment case we define the order 
parameter p{x) as the density of activity around point x 
in space, see (fTol), 



p(x) = lim lim 



E 



{CTilJ , 



(25) 



(x-^)N<i<(x 



\)N 



The difference is that, in the multiple environment case, 
the density p{x) appearing in the replica theory is av- 
eraged over the environments. Local fluctuations of the 
density from environment to environment can be calcu- 
lated [H], but will not be considered here; only global 
fluctuations, averaged over space, are considered through 
the order parameter q. 

As in the single environment case a chemical poten- 
tial fJ.{x), conjugated to p{x), is introduced. In addition, 
a new order parameter, r, is necessary to describe the 
force conjugated to g, and controlling the fluctuations of 
the spin magnetizations. All order parameters are deter- 
mined through the optimization of the free-energy func- 
tional T{q, r, {p{x)}, {p{x)}), see Appendix [C| whose ex- 
pression for the D = 1 case is given by 

J" = -Y'^if ~ 9) - -g V'(9, /3) + / da; p{x) p{x) 

1 
2 



Ax 



dy p{x) Jyj{x ~ y) p{y) (26) 

^ f dx f Dz log (1 + e^-^^+Pf^i^) 



P 



where Dz — exp(— z^/2)/v27r is the Gaussian measure, 
and 



V'('?,/3) ^ E 
fe>i 



/3(g — /^)sin(fc7ru;) 



log 1 - 



k-K — /3{f — q) sm(k'Kw) 
P{f ^ 1) sin(fc7ru') 



fcTT 



(27) 



Parameter a = L/N , hereafter called load, denotes the 
ratio of the numbers of environments and of cells. Again, 
optimization is done over densities p{x) fulfilling con- 
straint (12 1. 



Extremization of the free energy functional leads to the 
saddle-point equations 



2(?-nE 



fc>i 



k-K 



sin(A:7rw) 



PU-q) 



dx / Dz [1 + e 



-I3z^/ar—fiii{x)'\ 



p{x) = /dz [1-f, 



- /3 z y^or — ^ /^ ( a; ) 1 



(28) 



p{x) 



dy Jw{x - y) p{y) + A , 



where A is determined to enforce constraint (12 1 



The expression of J^ and of the saddle-point equations 
for the D = 2 case can be found in Appendix |A 2[ 



IV. THE PHASES AND THEIR STABILITY 

In both D = 1 and 2 dimensions three qualitatively dif- 
ferent solutions are found for the extremization equations 
of J^, corresponding to three distinct phases of activity: 
a paramagnetic phase in which the activity is uniform 
over space, a 'clump'-like phase in which the activity is 
localized in one of the stored spatial maps, and a glassy 
phase where the activity is neither uniform nor coherent 
with any map. We now discuss the domains of existence 
and stability of each phase. We are chiefly interested 
in the clump phase domain, which corresponds to the 
experimentally observed regime where memorized maps 
can be retrieved. As usual all expressions given below 
correspond to the D = 1 case, while the case D = 2 
is treated in Appendix |A 2| all numerical results will be 
given taking f = 0.1, w = 0.05. 



A. High noise: Paramagnetic phase 

At high temperature we expect the activity to be dom- 
inated by the noise in the neural dynamics, and to show 
no spatial localization. The corresponding order param- 
eters are: 

p{x) = / , q = f^ (paramagnetic phase - PM) . 

The activity profile is shown in Fig. [2]A_. The paramag- 
netic phase (PM) exists for all values of the control pa- 
rameters, with corresponding potentials: 



n{x) + X = Tlog 



I 



,1-/ 
We now discuss its stability. 



r = (PM) 



1. Case of a single environment (a = 0) 

In the single environment case the stability of the para- 
magnetic solution is determined by computing the Hes- 
sian of the free-energy functional J^ ( 11 ). We find that 



5^T 



5p{x)5p{y) /(I - /) 



5{x-y)-Mx-y). (29) 



The solution is stable as long as the Hessian is definite 
positive. 

In the one-dimensional case the most unstable mode 
corresponds to a spin wave 5p{x) ex sin(27r fcx), with 
wave number fc = 1; note that the fc = mode is forbid- 
den according to condition ([l2]) . The unstability develops 
under the spinodal temperature 



TPM - /(I - /) 



smTTW 



0.0045 



(30) 



Note that TpM and, more generally, all thermodynamic 
quantities are invariant under the changes f ^- 1 — f 
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FIG. 2: Average activity p{x) in dimension D = 1 in the para- 
magnetic phase (A) and in the clump phase (B: temperature 
T = 0, C: temperature T = 0.0073) for a — 0, computed with 
M — 2000 bins of discretization. 
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or/and w — > I — w, which simply amount to reverse 
tJi — >■ 1 — (Ji, i.e. to change active spins into holes and 
vice versa. 



FIG. 3: Paramagnetic phase stability region in the (T, a) 
plane, defined by T > TpM{a). 



2. Case of multiple environments (a > Q) 

The study of the stability of the PM phase in the mul- 
tiple environments case is reported in Appendix |E 1[ As 
in the single environment case the PM solution is unsta- 
ble at all temperatures T < TpM against perturbation of 
the activity of the type Sp{x) ex sin(27rfca;). In addition 
coupled fluctuations of \,r,q may lead to instabilities if 
T is smaller than TpM{ct), implicitly defined through 



E 

fe>i 



Tpj\/(a)fc7r 
/(I -/)sin(fc7rw) 



-1 



1 
2a 



(31) 



The instabilities correspond to the transition to the 
glassy phase, see Section |IVC| Note that Tpm defined 
in (30 1 corresponds with TpM{oi = 0). As a conclusion, 



in the {a^T) plane, the PM phase is stable in the region 
T > TpM {a) . This region is sketched in Fig. Is] 



B. Moderate noise and load: The clump phase 

In experiments place cells exhibit patterns of local- 
ized activity where neurons with neighboring place fields 
are active together. Our modelling reproduces such 
localized-in-space activity patterns (called 'bumps' or 
'clumps' of activity) at sufRciently low (a, T). The cor- 
responding phase, hereafter referred to as 'clump phase' 
(CL), is characterized by the order parameters: 

p{x) ^ f , q> P (clump phase - CL) . 

Correspondingly, the chemical potential p{x) will vary 
over space, and the conjugated force r is strictly positive. 



1. Case of a single environment (a = 0^ 

When the temperature T is sent to 0+, assuming that 
f > w we find a solution to ( 13 ) that is localized in space: 



f w if |x|<i(/-w) 

[ if \x\>Uf + w) 

(32) 
and 



pix) 



1 if \x\ < f/2 
if \x\ > f/2 



(33) 



Any translation x -^ x + xq, with xq e]0; 1[, defines an- 
other ground state with the same energy. The activity 
profile is shown in Fig. [2t3. 

At small but finite temperature we have solved equa- 
tions (13) numerically by discretizing space with a large 



number M of bins of width 1/M, such that Mw and Mf 
are both much larger than unity. 

The shape of the clump of activity is now rounded off 
by the thermal noise; in addition, far away cells are ac- 
tive with some positive probability < /. This clump is 
reminiscent of a liquid phase, surrounded by its vapor. 
The clump persists up to some critical temperature Tcl , 
at which it disappears. The value of Tcl depends on 
/ and w, e.g. Tcl - 0.008 for / = 0.1, w = 0.05. A 
representative shape of the activity clump at finite tem- 
perature is shown in Fig. WC. The dependency on / and 
w will be studied in section |VII[ Notice that Tcl also 
slightly depends on the number of bins of discretization 
M as shown in Fig. |4] 

The clump phase is also found to be present in dimen- 
sion D = 2. At finite temperature we solve equations 



(A6) numerically as in the one-dimensional case. An ex- 
ample of two-dimensional clump is shown in Fig. [5] 
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FIG. 4: Numerical effect: Tcl as a function of the number 
M of discretization bins for w — 0.05 (circles), w — 0.1 (tri- 
angles) and w = 0.15. Tcl reaches its asymptotic value at a 
saturation M that is a decreasing function of w. 



2. Case of multiple environments (a > 0) 

We look for a solution with localized activity in the 
first environment, and non-localized activity in the other 
environments. We have solved the coupled extremization 



(281 in one dimension using the numerical procedure de- 



scribed above. We observe that, at a given temperature, 
increasing a has the effect of squeezing and lowering the 
clump (Fig. [6]). Note that, because the disorder is av- 
eraged, the clump solution is invariant by translation in 
space as in the single environment case (bumps of activ- 
ity centered on all positions have the same free-energy). 
Nevertheless, for a given realization of disorder this in- 
variance by translation does not exist. In any case, when 
the rodent wanders in a familiar environment, some input 
containing information about its position (sensory cues 
and/or path integration) is supposed to act as a strong 
local field that selects the clump centered on the right 
position. Here we consider the states of the network in 
the absence of external input. 

We have studied the stability of the clump solution 
against longitudinal and replicon modes. The longitudi- 
nal stability domain is found by determining the bound- 
ary in the {a,T) along which the clump abruptly col- 
lapses. This boundary, shown in Fig. [7J can be described 
by two sections of curves: 

• at small a the clump phase is longitudinally stable 
for T < rci(a), a slowly decreasing function of a, 
which coincides with the temperature Tql found 
for a single environment when a — > 0. 

• at small temperature, the clump phase is longitudi- 
nally stable if a < acL{T), an increasing function 
of T. We denote acL its value when T ^ 0. 




FIG. 5: Two-dimensional clumps of activity for a single envi- 
ronment (a — 0) at temperature T = 0.0055 computed with 
M — 400. The whole clump p{x, y) is shown in the top panel, 
while the bottom panel shows the radial cut of the profile. 



• At intermediate temperatures a weak reentrance is 
present. The curves Tcl (a) and acL{T) merge 
at a point where the tangent is vertical and the 
reentrance begins. 



Numerically, a slight dependency on M is observed. 

Along the boundary of the clump phase the value of 
the Edwards- Anderson parameter increases from q — P 
in (a = 0,r = Tcl) to q = / in (a = acL.T = 0). 

Calculation of the stability against replicon modes is 
detailed in Appendix |E3| We find that the replica- 
symmetric solution is stable, except in a small region 
confined to small T and a close to acL- This result is 
shown by the dashed line in Fig. [7) It is reminiscent of 
the results for the 'retrieval phase' in the Hopfield model 
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FIG. 6: Effect of the load a on the clump: average activity 
p{x) in dimension D = 1 in the clump phase at temperature 
T = 0.004 for a = (left) and a = 0.02 (right). 



FIG. 8: Domain of existence of the glassy phase in the (T, a) 
plane. The phase is always stable against longitudinal stabil- 
ity. Replica symmetry is always broken. 
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Correspondingly the chemical potential fJ-{x) does not de- 
pend on X, and r > 0. 

As reported in Appendix |E2| the glass phase is found 
when T < Tsoict), where Tscice) is the same line 
TpAf{a) found above. Within this region, the SG phase is 
always stable against dumpiness (localization of the ac- 
tivity). The spin glass phase is always unstable against 
replicon mode, indicating that replica symmetry is al- 
ways broken, similarly to the spin glass phase in the Hop- 
field model tl6j . Results are summarized in Fig. [s] 



V. PHASE DIAGRAM 



A. Transitions between phases 



FIG. 7: Domain of stability the clump phase, computed with 
M — 200. The longitudinal and replicon instability lines cor- 
respond to, respectively, the full and dashed lines. Because of 
numerical calculation times, only a few points of the replicon 
line could be computed; they are represented by circles. 



C. High load: The glassy phase 

At large a the disorder in the interactions is strong 
enough to magnetize the spins locally, without any co- 
herence with any spatial map. Again, the average of the 
activity (ci) j will depend on the realization of the envi- 
ronments, while the average over the environment, (cri)j 
will be uniform in space and equal to /. In this glassy 
(SG) phase the order parameters will take values 

p{x) = / , q> f (glassy phase - SG) . 



The first-order phase transitions occur when two 
phases have the same free energy. The critical lines are 
found numerically. In dimension 1, 

• The clump-paramagnetic transition at high tem- 
perature occurs slightly before the clump unstabil- 
ity line. We denote Tc{a) the corresponding tem- 
perature for a given a. 

• The clump-glass transition occurs at a load denoted 
OigiT) for a given temperature T. Here again, we 
find a slight reentrance at moderate temperature: 
ag{T) is maximal for T k, 0.004. Since the glassy 
phase has been shown to be replica-symmetry bro- 
ken, its free energy is expected to be higher than 
in the RS case; therefore the 'real' transition is ex- 
pected to be slightly shifted to higher values of a. 

• At high a, T there is a second-order transition be- 
tween the PM and the SG phases. 
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FIG. 9: Phase diagram in the {T,a) plane in D = 1. Thick 
lines: transition between phases. Thin dashed lines reproduce 
stability regions described above. Critical lines are computed 
with M = 200. 



FIG. 10: g as a function of T for fixed a: a = (solid 
line), a — 0.01 (dashed line) and a = 0.015 (dots), com- 
puted with M — 1000. A discontinuity is observed at the 
clump-paramagnetic transition. 



The phase diagram in climcnsion 1 is summarized in 
Fig. Ill 

It is interesting to em.phasize the differences between 
this phase diagram and the one of the Hopfield model 
computed in [TB]. In the Hopfield model, the 'retrieval' 
or 'ferromagnetic' (FM) phase (which corresponds to our 
clump phase) has a triangular shape in the (a, T) plane. 
The temperature at which the FM phase becomes unsta- 
ble at a given a is smaller than Tpm{q.). There is no co- 
existence between the PM and FM phases, and both are 
separated by the glassy phase. Moreover, for the Hopfield 
model, Tp]\j(a) is monotonously decreasing so the capac- 
ity is maximal at zero temperature ^2j. Consequently, 
it seems that our model of attractor neural network is 
much more robust to noise than the standard Hopfield 
model. This can be understood considering the structure 
of the coupling matrix. In the Hopfield model one pat- 
terns defines a single direction in the configuration space; 
interference with other patterns and dynamical noise may 
push the activity configuration in the high-dimensional 
orthogonal subspace, and the memory of the pattern is 
easily lost. In the present case, on the contrary, one map 
defines a whole collection of configurations (bumps) cen- 
tered on different locations, thus the synaptic matrix will 
make the network converge to one of the attractors, even 
in the presence of a high level of noise. This robustness 
to noise will also be an interesting feature in the study 
of the dynamics of the model. 

When the transition line is crossed there is a discon- 
tinuity in the order parameter q. We have computed 
numerically the value of the Edwards- Anderson param- 
eter at different points and plotted its evolution at the 
clump-paramagnetic transition at fixed a (Fig. 10) and 
at the clump-glass transition at fixed T (Fig. Ill ) . 
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FIG. 11: q as a function of a for fixed temperature: T = 0.002 
(solid line) and T = 0.004 (dashed line), computed with 
M — 1000. A discontinuity is observed at the clump-glass 
transition. 



B. Numerical simulations 

We have performed Monte Carlo simulations to ther- 
malize the Ising model. The system is initialized with 
two types of conditions (respectively, uniform and clump 
configurations). At each time step, two neuron indices i, j 
are chosen such that ai = 1 — aj. We then calculate the 
change in the energy when the two spins are fiipped, and 
perform the flip or not according to Metropolis' rule. As 
a consequence the activity is kept constant (and equal 
to fN over the neural population), and the system is 
guaranteed to reach equilibrium for sufficiently long sim- 
ulation times. 
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FIG. 12: Average energy for the unidimensional model with a 
single environment and for increasing sizes A'^. For each size, 
we plot the average energy obtained after thermalization for 
ION Monte Carlo steps starting from the uniform and from 
the clump configurations. Each point is averaged over 1000 
simulations. 



Single environment case 



Fig. 



12 shows the average energy E{T) vs. the tem- 
perature T, for various sizes N . At high temperature, 
E{T) = —\pw as expected in the paramagnetic phase. 
At low temperature, the shape of the activity clump 
varies with T, and so does E{T). We find a clear signa- 
ture of the first order transition as N grows. The critical 
temperature is in excellent agreement with the analytical 
value for T^.. 



We plot in Fig. 13 the spin-spin correlation, > 

N 



aiCF., 



a function of the normalized distance, d ■ 



C{d) = {(Tiai+dN) 



(34) 



At low temperature, finite size effects are negligible and 
C{d) is a non trivial decreasing function of d in the large 
N limit. At small d, C{d) is of the order of /, and then 
decreases to a much smaller value over a distance of the 
order of /. As the location of the clump is arbitrary, we 
expect its center xq to be uniformly distributed over the 
\—\\ \] interval. The correlation is therefore given, in the 
thermodynamic limit, by 



C{d) 



dxQ p{xq) p{xo + d) 



(35) 



At zero temperature, this formula gives C{d) ~ f — d 
for d < f, C{d) = for d > f. At finite temperature, 
we compute p from the extremization equation (13), and 
plug the value into the r.h.s. of (35 1. The agreement 



with the correlation C{d) obtained from MC simulations 
is perfect (Fig. 13 1. 
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FIG. 13: Correlation C{d) between spins at distance d |34| 



at low (left) and high (right) temperatures, and for various 
sizes N. A. T = .004, B. T = .01. Note the difference of 
logarithmic scale on the y-axis between the two panels. 



At high temperature and for finite N, C{d) decreases 
over a distance d ~ |^ to the paramagnetic value /^. 
When N -^ oo, C{d) is uniformly equal to /^ at all dis- 
tances d > 0. As an additional check of the value of Tc we 
find that the spin-spin correlation decays quickly with in- 
creasing N for T = .0074, and saturates to a d-dependent 
value larger than /^ for T = .0072 (not shown). 



2. Multiple environments 

The same Monte-Carlo simulations have been per- 
formed with several environments, corresponding to ran- 
dom permutations of the sites, additively encoded in the 
coupling matrix. We have verified numerically the the- 
oretical predictions for p{x) (Fig. 14 1 and r (Fig. 15 1. 



This latter quantity can be accessed by measuring the 
local fields at different positions, p{x) -I- A + zy'^ar. The 
quenched noise on the field comes from the contribution 
of environments £ > 1: z^far is a Gaussian random vari- 
able of mean and standard deviation \Jar independent 
of X. In our simulations we have measured the contri- 



bution hi 



N 



^ ^ JfjCTj of environments ^ > 1 to the 



fci J 



local field at different locations. We have checked that 
their distribution matched the prediction of a Gaussian of 
width a r with excellent agreement (see inset in Fig. 15 1. 

We have also investigated the behavior of the sys- 
tem for varying levels of noise and load, and com- 
pared it to the phase diagram found analytically. 
In simulations we have considered the environment 
£ of lowest energy (in which the activity acquires 
a clump-like shape) and measured its contribution 
to the energy density, E^Hcr^}] = -j^Y^Kj 4j <^i<^j ■ 
This quantity is compared with the theoretical value 
-^Jdxdy p{x)J^(x - y)p{y). 

We have run simulations for different temperatures and 
numbers of environments, with N = 2000 and N = 5000 
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FIG. 14: Chemical potential jj Yl 
for a = 0.01 and T = 0.004: analytical prediction fi{x) (red 
solid line) and result of simulation (black dashed line) with 
A'' = 10*, averaged on 10^ rounds of lOA^ steps. 



FIG. 16: Density of energy in the environment coherent with 
the clump for constant a = 0.01 (same realization of the dis- 
order): results of Monte Carlo simulations for A'^ = 2000 (cir- 
cles) and A'" — 5000 (triangles) with error bars, compared to 
analytical result computed with M = 1000 (line). 
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agiT) < a°bserved < c.cl(T), 



due to the 



larger load, 'ji.gy^ ^ ^ ^ 

replica-symmetry broken nature of the glass phase. This 



expectation is corroborated by Fig. 18 which represents 
the fraction of simulations ending in the glassy phase 
as a function of a for T = 0.004. We have checked 
that this fraction does not depend on the initial con- 
ditions of the simulation. The transition occurs around 
a ~ 0.018 ± 0.001 (uncertainty due to long thermaliza- 



tion times in the simulations), while ag 
T = 0.004 used in the simulation. 



0.0173 for 



FIG. 15: Contribution hi of environments ^ > 1 to the local 
field as a function of x in simulation with A*' — 10'*, aver- 
aged on lO'^ rounds of lOA'^ steps. Inset: histogram of hi 
(black rectangles) compared to the Gaussian distribution of 
mean fLw and standard deviation ^/ar (red line). The value 



ar 

(|28l 



10 is computed from saddle point equations 



units. After thermalization, the energy of the coher- 
ent environment is recorded after 10^ rounds of lOA^ 
Monte Carlo steps each. Results are shown in Fig. [16] 
and Fig. [17| 

The match with theoretical predictions is very good in 
the case of the clump-paramagnetic transition (Fig. 16 1. 



Concerning the clump- glass transition (Fig. 171, as we 



mentioned above we expect the transition to occur at 



VI. CHOICE OF PARAMETERS 



All the numerical computations above were performed 
with parameters values w = 0.05 and / = 0.1. The 
scope of the model is to account for the main qualitative 
properties observed in hippocampal recordings, so there 
is some arbitrariness in the choice of these values that we 
will discuss hereafter. To gain insight on the influence 
of the parameters on the behaviour of clump phase, we 
focus on two quantities representing its stability domain, 
namely acL and Tcl, respectively the load at which the 
clump phase becomes unstable at T = and the temper- 
ature at which the clump phase is unstable when a = 0. 
We also study the influence of w and / on first-order 
transitions, through ag and T^, respectively the load of 
transition to the glassy phase at T = and the temper- 
ature of transition to the PM phase at a = 0. 
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FIG. 17: Density of energy in the environment coherent with 
the clump for constant T — 0.004: results of Monte Carlo 
simulations for A*' — 2000 (circles) and A'' = 5000 (triangles) 
with error bars, compared to analytical result computed with 
M = 1000 (line). 



the size of place fields depends on the size and complex- 
ity of the environment and on the behavioral context. A 
value w — 0.05, i.e. place fields occupying a few percents 
of the total space, is reasonable [25]. We have varied w 
for different values of /, and have found that Tql is a 
monotonously increasing function of w (Fig. 19). This 
result agrees with the intuition that increasing w makes 
the clump phase more favorable energetically. It also ap- 
pears that OiQ\^{vj) has a maximum around w ^ f. In 
terms of storage capacity, this result suggests that there 
exists an optimal choice for the parameters: for a given 
level of inhibition hence a given number fN of active 
neurons, choosing w '^ f maximizes the proportion of 
these active neurons that are located in the place field. 
Given that the quenched noise coming from other envi- 
ronments is constant over space (see Fig. 15), u" '--^ / is 



a trade-off between limiting the cross-talk and using the 
active neurons in the area covered by the place field. 

As far as thermodynamic transitions to the glassy and 
PM phases are concerned we find that T^ and ag behave 
similarly to, respectively, Tcl and acL when w varies, 
as shown in Fig. 20 Consequently, the qualitative aspect 



of the phase diagram remains the same when w varies. 
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B. Total activity / 

Parameter / is the activity level of the network fixed 
by global inhibition. As expected, Tql is a monotonously 
increasing function of / (Fig. 21 1. We find again a max- 
imum of acL when / is of the order of w, consistently 
with the previous results. We also find that the bound- 
ary of the transition lines in phase diagram, ag and Tc, 
behave similarly to acL and Tcl (Fig. 22). 



VII. EXTENSIONS AND DISCUSSION 



A. Taking silent cells into account 



FIG. 18: Monte-Carlo simulations around the clump-glass 
transition for T — 0.004: fraction of simulations found in 
the glassy phase after 100 rounds of lOA'^ steps, as a func- 
tion of a and for different A'^, with error bars. For each point 
the fraction was calculated from 50 simulations, half of which 
were started in a clump configuration and the other half in a 
uniform configuration. 



Thompson and Best [3] reported that not all pyramidal 
cells have place fields in a given environment: a significa- 
tive fraction of them (63% in their recording in CAl) 
being silent in this particular environment. To take this 
effect into account, our model can be further refined to 
incorporate partial activity of the cell ensemble. We as- 
sume a fraction 1 — c of silent cells, each environment 
being encoded by a subset of cN units: 



A. Size of place fields w 

Parameter w is defined as the size of the place fields 
in relation to the size of the environment; hence w de- 
fines the range of interactions resulting from the learning 
process. It fixes the width of the clump in the phase of 
localized activity. Experiments on rats have shown that 



• In the reference environment (environment 0), cN 
given spins ai among the N are assigned regurlarly 
spaced place field centers p{i) and they interact 
through the coupling matrix 



7° - 
•Jki — 



i iidikj)<^ 
otherwise 



(36) 
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FIG. 19: Influence of w on the clump phase: Tcl (top) and 
acL (bottom) as a function of w, for different fixed values 
of /. Note the maximum around lu ~ / in the latter graph. 
Computations were done with M = 1000. The numerical 
error is SacL ~ 0.005. 



The contribution to the energy is 

i<j<cN 



(37) 



• In each of the L other environments, each spin ai 
(of the all N spins) is selected with probability c 
and the place field centers are reshuffled by random 
permutation tt^. For each i let the random dilution 
variable 



1 with probability c 

with probability 1 — c 



The corresponding energy writes 

i<3 



(38) 



(39) 



FIG. 20: Infiuence of to on the first-order transitions: Tc (top) 
and Ug (bottom) as a function of w, for different fixed values 
of /. Computations were done with M = 1000. 



We incorporate this new hypothesis in the calculation 
of the average over disorder of the replicated partition 
function. The average is now over two types of disorder: 
the permutations tt^ and the selection of involved cells 

rf- 

We still consider configurations {cf} satisfying con- 
dition (|6|. Moreover, for each realization of the Ti we 
restrict the sum over configurations satisfying 



1 



N 

cN '^ 

i—l 






(40) 



that is, the global inhibition is homogeneously dis- 
tributed over the different subpopulations of neurons. 
This hypothesis is reasonable regarding the effective ac- 
tion of inhibitory cells on the network that we want to 
model. We can show that, at the order -^ it is always 
true if ^ is satisfied. 

The calculation, detailed in appendix |D] follows the 
same steps as in the c = 1 case. The only difference 
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FIG. 21: Influence of / on the clump phase: Tcl (top) and FIG. 22: Influence of/ on the first-order transitions: Ta (top) 
ctcL (bottom) as a function of /, for different fixed values of and Og (bottom) as a function of /, for difl'erent fixed values 



w. Note the maximum around / ~ w in the latter graph. 
Computations were done with M = 1000. The numerical 
error is SacL ~ 0.005. 



of w. Computations were done with M = 1000. 



is that one has to be careful when averaging over the 
two different disorders: we first perform the average over 
permutations for a given reahzation of the r/, and then 
over the dilution variables r/. We obtain the following 
expression for the density of free energy in one dimension: 



where q is defined as before and 



Fc = -^r{f -q) - -ij)c{q,l3) + c j dx fi(x)p{x) + (1 - c)fi2f 

2 
c 

\^ ^ ^) I 7-.„l /l , ^f3z^/^+f3fi2 



dxdyp{x)J^{x - y)p{y) - Ac( j dx p{x) - /) 
da; /Dzlog(l-Fe^^^^+'^^(^) 



P 



Dz log 1 



(41) 



Mq,l3) = J2 



f3c{q — p) sm{kTTw) 



fc>i 
- log ( 1 - 



kiT — (3c{f — q) sin(fc7rw 
/3c(/ — q) sin(fc7ru') 



kir 



(42) 
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The optimization equations are 

fcTT 

sir 

fc>l 



2cHq-f)Y: 



sm{kT:w) 



Pc{f - q) 



q = c dx Dz[l + e-/3^v^-/3A'W]-2 

+ (1 - c) / Dz[l + e-/5-v^-/3'^2]-2, 

p{x) = jDz[l + e- 



-^z^/ar—|3fJ,{x)'\ —1 



^(x) = c / dy J„ (a; - y)p{y) + A 



da;p(x) = / , 



/= /D2[1 



-Pz^/ar—/3fj.2] 



(43) 



In the partial activity model, the active spins (with ac- 
tivity p{x)) obey equations that are very similar to the 
previous case, with a dilution factor coming from the 
silent spins which are in a paramagnetic phase. From a 
qualitative point of view the behavior of the system does 
not differ significantly from the system with all spins ac- 
tive {c — 1). We have computed the effect of varying c on 
the value of Tc and a^: Tc is found to be a linear function 
of c, while a„ is a monotonously increasing function of c. 



Results are shown in Fig. 23 



B. 



Relationship with linear threshold models and 
previous studies 
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Several attractor neural network models for hippocam- 
pus have been proposed in previous works. Tsodyks 
& Sejnowski [25] proposed a rate model with semi- 
linear threshold neurons, uniform inhibition and excita- 
tory synapses between neurons with neighbouring place 
fields, with a strength decaying exponentially with dis- 
tance. Their study was limited to the single environ- 
ment, one-dimensional case. They showed the formation 
of localized activity. Moreover, they studied the effect of 
inhomogeneities in the synaptic matrix due to irregular- 
ities in the learning process, an interesting effect that we 
do not address here. 

Battaglia & Treves [TS] introduced the multiple envi- 
ronment storage in additive synapses. They studied the 
case of linear threshold neurons with generic form of ker- 
nel of connection weights. The free-energy is calculated 
implementing the threshold linear transfer function and 
averaging over disorder in the replica-symmetric approx- 
imation, along the lines developed in [26]. The clump 
phase is studied at zero temperature, and the storage 
capacity is found as the maximal value of a for which lo- 
calized solutions exist. Different forms of couplings and 
varying sparsity of the representation are considered, and 
a enlightening parallel with episodic memory is proposed. 
The issue of information storage is addressed. 



FIG. 23: Effect of partial activity: Influence of the fraction 
c of active cells on the clump domain: T^ (top) and Og (bot- 
tom) as a function of c, for different fixed values of / and w. 
Computations were done with M = 200. 



Our method is in the same spirit as PSI , but the model 
differs as we consider binary units instead of threshold 
linear units (i.e. without saturation) for a simple cou- 
pling matrix and an explicit form of inhibition. Never- 
theless, a parallel can be drawn between the range of 
interaction w in our model and the 'map sparsity' rpr 

in [18]. In spite of the differences between the models, 
the order of magnitude of the maximal storage capacity 
is the same in both models: ~ 3.10"^ in ID, ~ 8.10"'^ in 
2D (see Fig. 1 and 2 in 18J). The 'chart sparsity' ac in 
[l8] corresponds to our parameter c. 

The main difference between both models lays in the 
way noise is taken into account. In [TS], the level of noise 
is embedded in the rate model, in the gain g of the units, 
and is not taken into account in the thermodynamics 
since the study is carried out at zero temperature. Our 
model considers binary units with a level of noise T corre- 
sponding to the thermodynamic temperature. On aver- 
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age binary neurons behave as rate neuro ns wit h sigmoidal 
transfer function of gain ^ (see section II C). From this 
point of view our model is more microscopic than the one 
in |18j , as we have a description of noise at the neuron 
level. Furthermore, we have looked at the stability of the 
clump phase against replicon modes. Our study also in- 
cludes the other regimes of activity of the model (i.e. the 
PM and SG phases) and their thermodynamic stability 
compared to the clump phase, summarized in the phase 
diagram. 



C. Conclusion 

In this paper we have introduced an attractor neural 
network model for the storage of multiple spatial maps in 
the hippocampus. Although very simplified, the model 
accounts for experimentally observed properties of place 
cells, such as the remapping of place fields from one en- 
vironment to the other. We showed that multiple maps 
can be simultaneously learned in the same network, i.e. 
with the same synaptic coupling coefficients, even in the 
presence of noise in the neural response. Remarkably, 
moderate levels of noise can even slightly increase the 
capacity storage with respect to the noiseless case. No- 
tice that the qualitative behaviour of the model is robust 
to changes in the value of the parameters; for instance we 
do not expect that changing the couplings from a square- 
box function into an exponentially decreasing function 
over the distance wN in _D = 1 or y/wN in D = 2 would 
affect much the phase diagram. 

The storage of a map manifests itself through the 
fact that the neural activity is localized, and acquires 
a clump-like shape in the corresponding environment. 
When the load (number of environments) or the noise 
are too high the neural activity cannot be localized any 
longer in any one of the environments. For high noise, 
the activity, averaged over time, simply becomes uniform 
over the space. For high loads the activity is not uniform, 
but is delocalized with spatial heterogeneities controlled 
by the cross-talks between the (too many) maps. The 
prevalence of the glassy phase at high load and of the 
uniform (paramagnetic in the physics language) phase at 
high noise moderately limits the extension of the clump 
phase. Moreover, we have found that in the glassy phase 
the replica symmetric assumption is not correct, and 
we may expect from general consideration about replica 
symmetry-breaking that the first-order transition from 
the clump phase to the glassy phase occurs at higher 
loads a. Remarkably the clump phase is therefore the 
thermodynamically dominant phase in nearly all of its 
stability domain. 

Our work would deserve to be extended along other 
directions. First the assumption that synaptic cou- 
plings additively sum up the contributions coming from 
all the environments could be lifted. We could re- 
place the synapses J^ with non-linear function G{Jij). 
The additive case corresponds to G{x) = x, while a 



strongly non-additive synapse is obtained with the choice 
G{x) = min(a;, j^): synapses can be written in only once, 
and contributions from different environments do not add 
up but saturate the synaptic coupling. It would be worth 
extending the study of nonlinear synapses done for the 
Hopfield model |27l EH] to the present model. 



Secondly we have considered that the only source 
of (quenched) noise was the interference between the 
multiple environments. In other words, in the single- 
environment case, our synaptic matrix is translation- 
ally invariant and the center of the activity clump can 
be moved at no energy cost in space. This idealizing 
assumption was done to study the effect of multiple- 
environment cross-talk only. However, even in the sin- 
gle environment case, place fields do not define a per- 
fectly regular covering of space. We expect that such 
heterogeneities in the couplings will further destabilize 
the clump phase, and decrease the storage capacity p7] . 
Quantifying those effects would be interesting. 

However the most important extension seems to us 
to be the study of the dynamics. The richness of the 
phase diagram we have unveiled here and the multiplic- 
ity of phases for the system raise the question of if and 
how the network activity makes transitions between those 
phases. Multiple environments stored in the same net- 
work not only influence the shape of the clump and lead 
to transitions to a glassy phase, but they can as well pro- 
voke transitions between attractors. The study of these 
transitions, of the corresponding reaction paths will be 
reported in a companion paper [3T]. It could reveal use- 
ful to interpret recent experiments, where changes of the 
hippocampal activity resulting from the 'teleportation' 
of the rat have been recorded [20] . In addition it would 
be interesting to understand in a more quantitative way 
the activated diffusion process of the clump in an envi- 
ronment. Under the presence of other maps, the clump 
does not freely diffuse and quantifying the barriers op- 
posing motion, as well as understanding the qualitative 
difference between motions in ID and 2D spaces would 
be very useful. 
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Appendix A: Formulas for two-dimensional maps 

1. Single environment - Stability of the PM phase 

With periodic boundary conditions we can write the 
Fourier expansion 



5p{x)^Y.^p{k)e^ 



(Al) 



where the sum runs over vectors k belonging to th e re- 
ciprocal lattice and A; ^ because of constraint ( 12 ). 



To simplify the computation we replace the disk of inter- 
action by a square: Jw{u) = 1 if \ux\ and \uy\ < ^, so 
that 



E 



dye 



ik-y 



E 



ij;.gSm{kiTT^/w) sin(fc27rY^) 



"" \S-y\<^ 



fcl,fc2 

#(0,0) 



klk27T^ 

Therefore all eigenvalues are positive provided that 

sin(ki'Ky'w) Shl(k27T \/w) ' 



T > Tflj where 



TFm = /(I - /) max 

{fcl,fe2 
#(0.0)} 



kik2'!T^ 



fii-f)V^ 



sin(7r-\/w) 



(A2) 



nlD 



In the case of w << 1, Tp'^j w TpJ^J. 



2. Order parameters for multiple environments 

The only difference in the replica computation lays in 
the eigenvalues of the coupling matrix. Thus, in dimen- 
sion 2, the free energy functional writes: 



J" 



■2D 



- / dxdy p{x)J^{x ~ y)p{y) + j dxfi{x)p{x) 



P 



dx I Dz\og{l 



^I3z^/ar+l3ij.(x)\ 



(A3) 



where 



^2D(,,^)^2 ^ 



{kiM) 

#(0,0) 



P{q-P) 



Hki,k2)-/3if-q) 



log(l 



/?(/-g) 
4>{ki,k2) 



(A4) 



with 



0(fci,fe) 



kik2'!T^ 



sin(fci7ry^) sin{k2Tr^/w 



(A5) 




0.008 



0.006 



-0.004 



0.002 



FIG. 24: Solid line: Longitudinal stability region of the clump 
phase for D — 2. The D = 1 case is shown in thin dashed line 
for comparison. 



Hence the saddle point equations write: 
r = 4(q-/2) J2 i4>{ki,k2)-/3{f-q)r\ 

iklM)7^{0:0) 

p(f)= fBz[l + e-^'''^-^''^^Y\ 

p,{x) = I dyJw{x-y)p{y) + A . (A6) 



where A is determined to enforce constraint ( 12 ) 



In the D = 2 case equations (13 1 can be simplified 



by exploiting the invariance by rotation: in polar coordi- 
nates 



^^-(r)=2 






dr' p (r')r' arccos 



2rr' 



2tt / dr'p^^{ry + X 



(A7) 



We thus computed p{r) in the clump phase and found 
the region in the (a, T) plane where this solution is stable 
against longitudinal modes. We find that this region is 
reduced compared to the D = 1 case, but its shape is 



qualitatively similar. The result is shown in figure (A2| 
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Appendix B: Average of the Boltzmann factor over 
a random environment 



The purpose of this appendix is to calculate 



^(^) - wT. 



m 



exp 






(Bl) 



with 



C = exp[-^nf{l-f) + N'^nwf] , 



1 a " 

^(-) - 1^ E «-p [? E 4 E(-^w - /)«o) - /)] 

(B2) 



i,j a=l 



where the sum is carried out over all permutations of N 

elements. 

The eigenvectors of the matrix j" are plane waves. Let 

Vqj denote the j*'' (real-valued) component of the g*'' 

normalized eigenvector, and A^ the associated eigenvalue. 

Then, 

N-l , ^2 

E4Kw-/)Ko)-/) = E \f E%. Ko)-/) 

(B3) 
Due to condition ^ we have discarded the homogeneous 
mode q = from the sum in ( B3 ) . Introducing a set of 
n{N — 1) independent Gaussian variables with zero mean 
and variance unity, denoted by <&" we can write (all odd 
powers of y/JI vanish after integration over the Gaussian 
measure) 



e(<?) = 



exp 



v^E^^«*9('^^o-)-/) 



q,a,3 
ok 



IT,* 



i + Et^ E K-v 



(2fc)! 



'92 J2 



V^qi^ 



92 



92fc -^jl,J2---J2k \ 91 92 



■'92fc,j2fc 



■*92:>* 



(B4) 



where 



rpai,a2,...,a2k -— 

Jl,*2,---,J2fc ~ 



(«(zi) - /)«fe) -/)••■ «(L) ~ /))- ■ 

(B5) 
Using Wick's theorem the 2fc-point correlation function 
of the $ variables is easy to calculate. The outcome is 
a multiphcative factor {2k — 1)!!, and the replacement 
of the 2k sums over the indices qm,o,m by on ly k in- 
dependent sums over qm,o,m- The value of T (B5) de- 



pends only on the number Af of distinct indices, im, 



and of their associated multiplicities. Power counting 
shows that T'^i'''2,.-,a2fc vanishes in the infinite N limit 

*l,*2,---,*2fc 

unless the set {ii, Z2, • . • , i2fe} includes exactly k distinct 
indices, each one with multiplicity two. When this condi- 
tion holds we write {arn,a'm) the replica indices attached 
to the m*'* distinct index i, with m — 1,2, ... ,k. Then, 
in the large N limit. 



ii,ii,i2,i2---,ik,ik 



n 



n 



(B6) 



Nevertheless, when summing over k in (B4), the inver- 

C30 

sion of limits A^ — > oo and ^ is allowed only in the 

fc=i 
cases where the \J P\vq,j{a'^,-', — f) are not too large 
so that the decomposition converges quickly. This is not 
the case if by any chance the configuration ct is coherent 
with the environment 0, because then a large number (of 
order N) of terms will have to be taken into account in 
the sum. The probability of such realizations is expo- 
nentially small in N. Since we are only interested in the 
environment we can discard those terms and consider 
only the realizations for which the approximation above 
is correct. 

We are left with the summation over the jVn indices. Us- 
ing the identities 



7 , ^9J' '^q'J ~ "9>9' 



(B7) 



we obtain from ( B4 1 the following expression 



?(-)-i + E^E-(^)' (B8) 



*;>! 



where the last sum runs over all weighted pairings among 
2k points, described as follows: 

• we define 2k points. The first k points carry the 
pair-indices {qrma-m)^ with m running from 1 to k. 
The second k points carry the same pair-indices. 
Hence, each pair index {qrmO-m) is shared by two 
points. 

• a pairing T' is a set of k bonds 
bt = {{q^^, am I,), ilni'^^ a jn'^)}, £ = l,2,...,fc, 
each joining one pair of points (dimer coverage). 

• the weight of the pairing is 

k k 



w{V) 



E nvn^«^...,('^""=^"'"^-/^ 



ai ,-■■ ,afc m— 1 



(B9) 



We denote q the overlap matrix with entries g"'' and 1„ 
the n X n matrix whose all entries are equal to one. 
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2 •- 



3 •- 




where we set Tj = Trace[(q — /^ !)•']. 

Combinatorial study shows that the number of such 
pairings is 



A^({(j,™,)})=fc!n 



1 /2J 



m,! V J 



(B14) 



FIG. 25: Two examples of pairings between 2fc points: Va 
(left) and Pb (right). 



Let's introduce a notation for the moments of the eigen- 
values: 



A'.-E-^;;=2Ef=^) 



9>1 



9>1 



(/TT / 



(BIO) 



Two examples of pairings are shown in Fig. |25[ The 
weight associated to the pairing Va is simply 



w{Va 



n 



EvE('?'^"'^"-/' 



(AiTrace[q-/2])' 
(Am /(I -/))', 



as all Kronecker S in ( |B9[ ) are equal to 1 by construction. 
The weight associated to the second pairing in Fig. |25] is 



j{Vb) = (As Trace[(q - ff]) (Ai Trace[q - f]) 



fc-3 



(B12) 



For a given pairing, 



• the horizontal bonds represent independent repli- 
cas : point number m leads to a factor 



Z^(7„ \m l^a„ 



pairing. 



P) in the weight of the 



• the vertical and diagonal bonds couple replicas to- 
gether 

We then have to calculate the combinatorial multiplic- 
ity of the weights, i.e. how many pairings have the same 
weight in the sum (B8). For a given fc, a pairing asso- 



ciates points by groups of j coupled replicas indices (i.e 
2j points). Let rrij be the number of such groups in a 
given pairing. We have '^^jrrij — k. Pairings V with 
the same {j, rrij ) have equal weights 



w{V)^wi{ij,m,)})=Y[iA,T,Y' 



(B13) 



Finally, using ^ jnij = k and (IBIOI, we can rewrite 



/3,fc-r-r NT^ 1 /2J-1^"^ 



«^)^i + E(|)' HE ,„,,,, 



k>l 



j rtij >0 



J 

exp [ - E Trace log[Id„ - /3A(q - f 1„)] 



(B15) 



Appendix C: Replica symmetric calculation of the 
free energy 

We introduce parameters r"''' conjugated to the over- 
laps g"^. With this notation, we have (up to a multiplica- 
tive constant): 

^ = E / n d^^'dr"" exp [Giiq^", r^'h ^)] (CI) 



a- a<b 



where 



(Bll) G({g'^^ r-'}, a) = NaP^ ^ ^"'(^ E <^' ^ 9"') 



a<b 

^E E <^." 

aTV E Trace log[Id„ - /3A(q - /^ 1„)] 

(C2) 



Written in a continuous form. 



P 



Eexp[a/3^E^"E->.^+^E E ->" 

S a<b I a |i_j|<li^ 

Jl ^p°(a;)^^''(a;)dA'' exp [iV E /3A°( /" dx p''(x) - /)) 



/3 / da;p"(a;)Ai''(x)-|-A^ / Ax log Z{{iJi'\x),r''''}) 



dxdyp''{x)Jy,{x-y)p''{y) 



where we have defined 



(C3) 



Z{{p'^{x),r^'}) ^ E exp[a/32^aVV"''-l-/3EM'"(a;)fT"] 

{iT'^} a<b a 

(C4) 
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In the replica symmetric (RS) Ansatz, we assume we obtain 



q'^b ^q 



^ 



\ogZ 



(C5) 



V a 7^ 6, V x, < p°'{x) — p{x) 
Under this assumption, we have 



T, = {n-l){f-qy + {f-f + {n-l){q-f)y, (C6) 



1 

= ^r{f -q)- ^^P{q,l3) - X{ J dxp{x) - f) 
+ / dxp{x)fi{x) - - dxdy p{x)J^{x - y)p{y) 



^ j dxBz log (1 + e/3V^^+/9M(:r)) 



(C13) 



and Z{{p'^{x),r'^^}) takes the expression 



Z{ti{x),r) 



Bz 



_^ ^l3z,/^+l3ti(x)~^ 



, (C7) 



so 



logZ(^(a;),r) ^n Dzlog(l + e'3^y^+'3^(^)-'^) 



n 

y 



Dzlog2(l + e'^^^°^+'^^(^)^'^) 



( / Dzlog(l + e'^^^^+'^^(=")-''^)) +0{n^) 

(C8) 

Under the RS hypothesis, the averaged partition func- 
tion has the form: 



Z« - I dq dr dX ^^(a;)^p(a;)e-"^'^-^[^(^)^''(^)'«''^'^l 

(C9) In D = 1 dimension. 



where we have changed ii{x) -^ p{x) — ^^. At the saddle 
point, which is found by writing 

dq dr dp{x) dp{x) dX 

we have 

2 Oil; 
''~~]3^1)q' 

p{x)= /"Dz[l + e-'^^^^-'^''(^)]-\ 
p.{x) = / dyJ^{x - y)p{y) + A, 
dxp{x) = J . 



where 



^[p{x), p{x),q, r, A, n] 






A-.25: 



fe>l 



sin(7rfcw) 



irk 



(C15) 



(C16) 



Defining Ak 



— Trk 



we have 



— A( / dxp{x) — /) + / dxp(x)p{x) 

- — J / dxlogZ(^(a:;),r) - - / dxdyp{x)J^{x - y)p{y) 

(CIO) 

For large N, the saddle point approximation gives 

(Cll) 



sin(7rkw) ' 

Ki - P) 



'■'"'"■"'^A^^^M^r'-'^'- A. 



W « e""^''-^* 



where J^* is an cxtrcmum of J^ over all {p{x)}, {p{x)}, 
q, r, X. 

The replica trick then allows to compute the density of 
free energy ^ from the first term in ,^ as n — > 0: Letting 



and 

r^'' = 2{q-f)J2[Ak-(3{f-q)]' 
fe>l 

In Z? = 2 dimensions, defining 
we have 



(C17) 
(C18) 



i;i«;27 



sin(A:i7r-\/w) sin(A:27ry^) 



1/3^ 
27 



^(g,/3)^^-^A,b-(g-/)^(/-gr^ + (/-g)^], 

(C12) 



Af-4^ 



ki,k2 



1 



(j){kik2 



(C19) 



(C20) 
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^2°(g,/3) = 2 J2 



(kiM) 

7^(0,0) 



P{q-P) 



0(fci,fc2)-/3(/-g) 



loK 1 



(-SSy))' <-' 



and 



r^^=A{q-f) Y. {4>{k^M) - Pif - q)) '■ (C22) 



{kiM) 



Appendix D: Silent cells hypothesis - calculation of 
the free energy 

We now consider the hypothesis that only a fraction c 
of cells are involved in each environment's representation 
(see main text). The partition function is now averaged 
over two types of disorder: the random permutation of 
the place field centers, as before, and the choice of the 
subset of cells participating in each map ^, i.e. the value 
of the random variables rf : 



Z"=5:exp[/3^^J°rOr>fa,"] 



a i<j 
L 



e-p[^EEE4-^w-^o-)<w< 



0)J 



e=l a i<j 



(Dl) 



where t denotes one realization of the L x N random 
variables r/, and the t° are 1 if i is a multiple of 1/c 
(in other terms, the place field centers for the reference 
environment are evenly spaced). The sum is now taken 
over configurations a satisfying two contraints: 






(D2) 



Using the function l{x) = 1 if x == and elsewhere, 
we write 



^" = ^Ei(^E<-/ 



all 



/9E E J''.r°r°a''<T» 



(D3) 
where C is a constant and in each environment £, 



xi-)^U^i:-'<-f)-^i^^-') 



(D4) 



with 






(D5) 



We can drop the ^ index since we will average over r. The 
computation of ^(o^, r) follows exactly the same steps as 
before and, using the same notations as in Appendix [B] 
we end up with 

^(<T, t) = cxp [ - ^ Trace log[Id„ - /3A(q - cf 1„)] , 

(D6) 
where q is now the n x n matrix of elements 

i 

We can now calculate x(<t): introducing parameters Rab 
conjugated to gab and Lagrange multipliers Xa to enforce 
the constraint on a, and letting 

e(q) = -J2 Trace log[Id„ - /3A(q - cf 1„)] , (D8) 



we can write 



x(<?)- 



dXa dRab dqab A^-/ E ^+V]v E fl„,,^„,+e(q) 



2ttVN2ttVN 27r 



iR 

xn(exp[-r,(i:-)|< + ^.>?)])^ 

(D9) 

Thus the i are decoupled and we can perform the average 
over the r^: the averaged term at each i is 



1— c + cexp [ — 2^ ~F='^' 



N 



N 



exp [ - y^ -^cr" 



Xa a I ^ab a 6] 

CT,- (7: 



N 



|-C(i C) / V— \ Xa „ Rab a b\'^^ 



(DIO) 
in the large N limit. Introducing the notations 

J^abc = ^ 2^^i^t^i ' 

i 

Sabcd = -^ E ^I'^'i'^i'^i ' (Dll) 

i 

we have 

x(<t) = / exp [^ e(q) + \^Rabiqab - cqab)] 



iK 



a<b 



exp [ 



c{l-c)_ 



7 ^ XaXbqab + XaRbcTabc + RabRcdSabcd) \ ■ 

(D12) 



a,b,c,d 
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After Gaussian integration on the Xa and Rab, we end up 
with (up to a multiphcative constant) 



a<b 



2n 



(D13) 



iR 

-N 
'2 



exp [— ^ [A %bcd{qab - Cqab){qcd - CQcd)] , 



a,b,c.d 



where 



Aabcd = c{l- c){Sabcd+ j[Q \bTacdTbcd)- (D14) 



Hence, in the large N Hmit, the integral is dominated 
by qab ~ cqab- 

Then we write the partition function and do the replica 
symmetric Ansatz as in Appendix [C] The difference is 
that now fi{x) and p{x) describe the activity of cells in- 
volved in the reference environment (a dilution factor c 
appears), the (1 — c)N other cells having a uniform ac- 
tivity. We thus derive the expression of the energy func- 
tional (111]) and the saddle point equations ( 43 1 . 



Appendix E: Stability of the replica symmetric 
solution 



The extremization of the free energy functional under 
the fixed-activity constraint and under the replica sym- 
metric assumption leads to three solutions corresponding 
to three different phases. We want to study the stability 
of those solutions in the {a,T) space. We will limit our- 
selves to the one-dimensional case. For this purpose we 
do a small perturbation of the solution and observe the 
behaviour of the free energy functional: 
If 



p^ix) -^ p''{x) + Sp''{x) 
H^ix) -> p^ix^ + Sp^ix) 

j.ab _^ ^ab i gj,ab 



(El) 



^,ab 



q' 



ab 



6q- 



.ab 



then ,J? ^ jF + S,^ +^6^.^ , 



where 



6^^ 



=0 



dxdy 



5p-{x) 


1 


Sp-{y) 


Sp'^ix) 

Sj.ab 


■M{x,y)- 


Sp^iy) 

^^cd 


Sq"'' 




Sq"'^ 



(E2) 



We thus have to study the hessian matrix M{x,y) that 
writes, in the {Sp'^{x),Sp'^{x),Sr'^'',Sq'^''} basis: 



M 



a^j^ 


d'^S^ 








ap-{x)dp''{y) 


8p-{x)dp.-{y) 


92 ^ 


0"^ 


0".^ 





dp<^(x)dp<'(y) 


diJ.<^(x)dp''(y) 


dp''{x)dr':'' 





d'\9^ 


a^jf 


a^jf 


dr-odp-iy) 


grabgr,,d 


g^abggad 








d^.9 


d^.9 


gqabg^ad 


gqabgq^d 



(E3) 
where the expressions of the elements of the different 
blocks are detailed hereafter: using the notations 



t{x) = {a)\^^ = / Dz[l -f e-'3^v^-^M(^)]-3 ^ 
s{x) = W%) = J D^[l + e-^-^-^^(-)]-4 , 
t = dx t{x) ; s = dx s{x) ; 92 = /da; q'^{x) 



we have 



2 ^ 



92^ 



dp°-{x)dp'^{y) 
dp°^{x)dp'^{y) 



(E4) 

-J™(a;-y).5"\ (E5) 

-- Six - y) ■ 5'^\ (E6) 



|2 ^ 



d^^ 



S{x — y)(3{p'^{x) — p{x)) ii a — b 
dp'^{x)dp''{y)~ \5{x-y)(i{p'^{x)~q{x)) otherwise ' 

(E7) 



92^ 



a(i'^{q{x)p{x) — t{x)) lia^c^d 



dp''{x)dr'"^ \al3'^(q(x)p{x)-q{x)) otherwise 



(E8) 



i2 esr 



92^ 



/3^(/ q^ - q) if a = c and b^ d 



bpt^cd 



Qj.abQj.. 



and, letting 



/33(/g2_s) ifa^&^CT^d , 



a'^l3^{J q^ — t) otherwise 



(E9) 



Bh 



kiT 



sm{kT:w) 



f^{f-q), 



fc>i 



c^-E 



fe>i 



Bl 



^3 = 2^ — m — 



Bt 
fc>i '= 
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\qabQqc 



-2a(Ci + 2C2 + 2C3) if a = c and 6 = d 



-2a{C2 + 2C3) 
The eigenvector equation writes 
M-w = A- w 



otherwise 



(ElO) 



(Ell) 



where v is the vector of fluctuations around the saddle 
point: 

Sp^ix) 



v{x) 



Sfi'^ix) 

§^ab 



Sq' 



.ab 



(E12) 



Following the same strategy as [2U] to exploit the sym- 
metry of the matrix elements under permutation of the 
indices, we look for orthogonal set of eigenvectors with 
the particular forms below 



vi {x) 



Sp'^ix) = 5p{x) Va 

5^°'[x) = 6p{x) Va 

Sr"'' ^ Sr Va, b 

Sq'''' = Sq Va, b 



(E13) 



Imposing the orthogonality conditions 

vl{x) ■ V2ix) = v{{x) ■ vli{x) = V2{x) • ui(a;) = , (E16) 



and taking the n — ^ limit in equations (Ell ), wc end 



up with two systems of equations: on the longitudinal 
modes the eigenvalues equation leads to 



- / dy J^ (x - y)5p{y) + 5p.ix) = A 5p{x) 

Sp{x) + (i{q - p){x)5fi{x) + a(i'^{q - t){x)6r = A 5p.{x) 

2a^2 J (^ „ q^^^^ ^ a^fi^{-q + 4t - 3s)(5r + ajSSq = \ Sr 



^ al3Sr - 2q(Ci - 2C2)Sq = X Sq 
and on the transverse modes it gives 



a^P^[-q + 2t- s]Sr* + afiSq* = A Sr* 
aPSr* - 2aCiSq* = A Sq* 



(E17) 



(E18) 



For each of the three phases determined above, the sta- 
bility regions in the (a, T) domain are delimited by lines 
where one of the eigenvalues changes signs. 
Note that the matrix of system (E17l is not symmet- 
ric while the hessian matrix S'^^ is: a — ^ factor ap- 
pears when taking the n — )■ limit since there are "^"^~ ' 
two-replica-indice components. This multiplicative fac- 
tor does not change the points where a given eigenvalue 
changes signs. Nevertheless, it has the effect of giving 
nonreal eigenvalues. To avoid this, we shall restore the 
symmetry by multiplying the appropriate lines by — |. 





- Sp-{x) 


^ 


Sp{x) 


if = 6* 






= 


Sp{x) 


otherwise 




Sp-{x) 


~ 


Sfi{x) 


if = 6* 


V2{x) = < 


§,,ab 


— 


Sfi{x) 
Sf 


otherwise /t^i ,x 
iiaorb^e ' (E14) 






= 


Sf 


if a and b ^ 9 




Sq'''' 


= 


Sq 


ii a or b = 9 




^ 


^ 


Sq 


if a and b ^ 9 




■ Sp-{x) 





S~p{x) 


if a = 61 or 9' 






= 


Sp*{x) 


otherwise 




Sfi^ix) 


= 


Sfl{x) 


if a = 6* or 6*' 






= 


Sp*{x) 


otherwise 




gj.ab 


— 


Sf 


if a = 6* and 6 = 6*' 


vhix) = < 




^ 


Sf 


if a or 6 = 6* or 61' ' 






~ 


Sr* 


if aandb^ 9, 9' 




Sq"'' 


— 


Sq 


if a = and 6 = 6*' 






= 


Si 


if a or & = 6* or 61' 




k 


= 


Sq* 


if a and b^9,9' 








(E15) 


where 6 and 6' are two fixed rephca indices. vi{x) and 


112 (x) are called Ion 


gitudinal 


modes; v^ix) are called 


transverse c 


r 'replicon' 


modes. 





1. Paramagnetic phase stability region 

Taking p{x) = /, qix) = f\ t{x) = f and a(x) = f 
for all X in ( |E17 ) leads to a very simple system, invariant 
under translation in the x space. 
We can solve it by Fourier transform: if 



Sp{x) 



'Sp{k) 



fe>0 

Sp{x) = Y. e^''''''=Sp{k) 

fe>0 



(E19) 



((5p(0) = is imposed by the fixed activity constraint), 
then the system (E17) decomposed on each Fourier mode 



gives: 



1. fc > components of the longitudinal matrix: 
these modes appear in the {S p{x) , S p{x)) region 
and solve a system with determinant 



(wkw) 



smiTTkw 



1 



PiP I) 



that vanishes for /3(fc) 
minimal for fc = 1. For / 
Ti w 0.0045. 



7r/c 

sin(7rfcji')(/-/^) 

= 0.1 and w 



(E20) 

which is 
= 0.05, 
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2. k = component of the longitudinal matrix: we 
get a system with determinant 

/' - / (3{P - P) 

2ap{p-p) a/32(-/2+4/3-3/4) 1 (E21) 

1 



^ 



These modes appear for (a,To(a)) at which this 
determinant vanishes, i.e. 



E 



fe>i 



To(a) kiT 



-1 



1 

2a 



(E22) 



./(l-/)sin(fc7rw) 
3. Replicon modes: these modes solve a system with 



determinant 

aP\-p + 2f-n 



1 

-2% 



(E23) 



This defines the same stability line ( E22 1 as found 
above. 

To sum up, the paramagnetic phase is stable at high tem- 
peratures; when T decreases at fixed a, it becomes insta- 
ble at rpM(Q:) = max{To(a),ri} as depicted in Fig.[3J 



2. Glassy phase stability region 

We find a uniform solution to the saddle point equa- 
tions (28 1 with q> P only for T < Tpuict). the region 



of existence of the glassy phase hence corresponds to the 
region where the PM solution is unstable. In this re- 
gion we find that the RS solution is always stable against 



longitudinal modes (E17) and always unstable against 
transverse modes (E18 ). The replica symmetric Ansatz is 



therefore not correct in the case of the glassy phase. The 
correct expression could be found by looking for replica- 
symmetry broken solutions. Since wc are chiefly inter- 
ested by the clump phase, we skipped this computation 
and did not investigate further the glassy phase. 



3. Clump phase stability region 

longitudinal modes: Due to the x dependency in 
this phase, we must use a numerical approach in 
a discretized space to study the eigenvalues of the 
longitudinal matrix. Since computation time for 
the matrix diagonalization limits dramatically the 
number of points in the discretization, we chose 
to study the longitudinal stability with a different 
method. Scanning the (a, T) plane, p{x) is com- 
puted by solving iteratively the saddle-point equa- 
tions ( 28 ) starting from a initial clump; the line of 



stability corresponds to the points where the clump 
collapses, i.e. the iteration converges to a uniform 
activity p{x) = f Wx. The result is shown in Fig. [t] 
in the main text. 

replicon modes: For all a,T., we compute numeri- 
cally q, t, s by solving iteratively the saddle-point 
equations as before, allow ing to calculate the de- 
terminant of system (E18). We looked for the line 
where this determinant vanishes. We found that 
replica symmetry breaking is limited to a small re- 
gion at the low T/ high a edge of the region of 
longitudinal stability, see Fig. [7] 
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